Recent progress in artificial intelligence (AI) has drawn attention to the technology’s transformative potential, including what some see as its prospects for causing large-scale harm. We review two influential arguments purporting to show how AI could pose catastrophic risks. The first argument — the Problem of Power-Seeking — claims that, under certain assumptions, advanced AI systems are likely to engage in dangerous power-seeking behavior in pursuit of their goals. We review reasons for thinking that AI systems might seek power, that (...) they might obtain it, that this could lead to catastrophe, and that we might build and deploy such systems anyway. The second argument claims that the development of human-level AI will unlock rapid further progress, culminating in AI systems far more capable than any human — this is the Singularity Hypothesis. Power-seeking behavior on the part of such systems might be particularly dangerous. We discuss a variety of objections to both arguments and conclude by assessing the state of the debate. (shrink)

Recent advances in natural language processing have given rise to a new kind of AI architecture: the language agent. By repeatedly calling an LLM to perform a variety of cognitive tasks, language agents are able to function autonomously to pursue goals specified in natural language and stored in a human-readable format. Because of their architecture, language agents exhibit behavior that is predictable according to the laws of folk psychology: they function as though they have desires and beliefs, and then make (...) and update plans to pursue their desires given their beliefs. We argue that the rise of language agents significantly reduces the probability of an existential catastrophe due to loss of control over an AGI. This is because the probability of such an existential catastrophe is proportional to the difficulty of aligning AGI systems, and language agents significantly reduce that difficulty. In particular, language agents help to resolve three important issues related to aligning AIs: reward misspecification, goal misgeneralization, and uninterpretability. (shrink)

Under what conditions would an artificially intelligent system have wellbeing? Despite its obvious bearing on the ethics of human interactions with artificial systems, this question has received little attention. Because all major theories of wellbeing hold that an individual’s welfare level is partially determined by their mental life, we begin by considering whether artificial systems have mental states. We show that a wide range of theories of mental states, when combined with leading theories of wellbeing, predict that certain existing artificial (...) systems have wellbeing. While we do not claim to demonstrate conclusively that AI systems have wellbeing, we argue that our metaphysical and moral uncertainty about AI wellbeing requires us dramatically to reassess our relationship with the intelligent systems we create. (shrink)

The inclusion problem for theories of gender arises when those theories inappropriately fail to include certain individuals in the gender categories to which they ought to belong. The inclusion problem affects both of the most influential traditions in feminist theorizing about gender: social-position accounts and identity accounts. I argue that the inclusion problem can be solved by adopting a structured theory of gender which incorporates aspects of both social-position accounts and identity accounts. According to the theory I favor, an individual’s (...) gender is determined by their gender identity if they have one; otherwise, it is determined by their social position. My structured approach to gender offers a more direct solution to the gender inclusion problem than alternatives recently advocated by Barnes (2020), Jenkins (2023), and others. It also points the way to a simple solution to inclusion problems that arise at the level of gendered language. (shrink)

Existing work on gaslighting ties it constitutively to facts about the intentions or prejudices of the gaslighter and/or his victim’s prior experience of epistemic injustice. I argue that the concept of gaslighting is more broadly applicable than has been appreciated: what is distinctive about gaslighting, on my account, is simply that a gaslighter confronts his victim with a certain kind of choice between rejecting his testimony and doubting her own basic epistemic competence in some domain. I thus hold that gaslighting (...) is a purely epistemic phenomenon—not requiring any particular set of intentions or prejudices on the part of the gaslighter—and also that it can occur even in the absence of any prior experience of epistemic injustice. Appreciating the dilemmatic character of gaslighting allows us to understand its connection with a characteristic sort of epistemic harm, makes it easier to apply the concept of gaslighting in practice, and raises the possibility that we might discover its structure and the associated harm in surprising places. (shrink)

Contextology is the science of the dynamics of the conversational context. Contextology formulates laws governing how the shared information states of interlocutors evolve in response to assertion. More precisely, the contextologist attempts to construct a function which, when provided with just a conversation’s pre-update context and the content of an assertion, delivers that conversation’s post-update context. Most contextologists have assumed that the function governing the evolution of the context is simple: the post-update context is just the pre-update context intersected with (...) the content of the assertion. We argue that this assumption is wrong: not only is it false, it is also incoherent given standard contextological assumptions. Moreover, it is impossible in principle to revise it to correctly describe the dynamics of context. We conclude that there can be no science of Contextology. The laws governing the evolution of the context in response to assertion must make essential reference to the private information states of interlocutors. (shrink)

The term 'covert mixed quotation' describes cases in which linguistic material is interpreted in the manner of mixed quotation — that is, used in addition to being mentioned — despite the superficial absence of any commonly recognized conventional devices indicating quotation. After developing a novel theory of mixed quotation, I show that positing covert mixed quotation allows us to give simple and unified treatments of a number of puzzling semantic phenomena, including the projective behavior of conventional implicature items embedded in (...) indirect speech reports and propositional attitude ascriptions, so-called 'c-monsters,' metalinguistic negation, metalinguistic negotiation, and 'in a sense' constructions. (shrink)

Let the label binary category terms refer to natural language expressions like ‘woman’, ‘man’, ‘female’, and ‘male’. Focusing on ‘woman’ and ‘female’, I develop a novel, empirically supported theory of the meanings of English binary category terms. Given plausible assumptions about the metaphysics of sex and gender, this gender-first theory predicts that the sentence ‘Trans women are women’ expresses a truth in all contexts and the sentence ‘Women are adult human females’ expresses a truth in most ordinary contexts — thus (...) that these two sentences can and usually do express logically consistent contents. The key feature of the proposed theory is that it treats both ‘woman’ and ‘female’ as sensitive to an individual’s gender when that individual belongs to a gendered category and to an individual’s sex otherwise. The existence and plausibility of a gender-first theory of this kind opens up conceptual room for trans-inclusive positions in the philosophy of sex and gender which endorse the claim that women are adult human females, thereby both accounting for trans women’s experiences of their bodies as female and helping to disarm the sentence ‘Women are adult human females’ as a trans-exclusionary slogan. (shrink)

This chapter introduces readers to the empirical questions at issue in debates over gendered pronouns and assesses the plausibility of various possible answers to these questions. It has two parts. The first is a general introduction to the linguistics and psychology of grammatical gender. The second focuses on the meanings of gendered pronouns in English. It begins with a discussion of some methodological limitations of empirical approaches to the topic and the normative implications of those limitations. It then argues against (...) three simple theories of the semantics of gendered pronouns in English and proposes an alternative that fares better: the Gender-First View. Finally, it discusses the singular use of 'they' and its connection to nonbinary gender identities. (shrink)